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The  present  document  is  the  final  annual  report  for  the 
B I ()C  Y d t:d N t*T I C COUi\u)L  IN  MAM-.MAJHINfc  I M rtrf  ACTION1  project  at  UCLA 
conducted  under  Advanced  research  Projects  Agency  Contract  Mo. 
L'OUJ  I e--b9-A-0200-40jo . l'he  project  began  in  April  19/3  under  a 
different  contract.  The  long  terra  goals  were  described  in  detail 
in  earlier  proposals  (UCLA  bng-P246b-H-/3  , P-2/1 9-C-4  and  UCLA- 
Eng-753:>)  and  are  reviewed  briefly  oelow. 

The  ultimate  goal  of  the  project  is  to  devise  methods  to  incor- 
porate electrophysiological  brain  signals  into  man-machine  com- 
munication procedures.  The  implementation  and  evaluation  of  such 
procedures  deals  with  perceptual,  cognitive  and  affective  modes 
of  communication. 

In  conventional  man-machine  uiaiogues  using  computer  terminal 
the  terminal  provides  most  of  the  external  environment  and  gen- 
erates stimulus  inputs  to  the  operator  in  the  form  of  graphic  or 
alphanumeric  displays.  Typically  the  response  is  the  selection  of 
a sequence  of  ke/board  commands.  This  motor  behavior  is  chosen 
based  on  an  analysis  or  the  situation.  A closer  coupling  could  be 
attains!  if  the  terminal  could  access  the  covert  as  well  as  the 
overt  responses,  and  bypass  to  some  degree  the  requirement  for  an 
explicit  motor  output. 

A closely  coupled  man-machine  interface  would  require  the  use  of 
a communication  mnao  with  the  following  characteristics* 

1.  Adequate  bandwidth;  i.e.  quick  access. 

2.  Low  over’rveaj  in  terms  of  voluntary  motor  activity. 

3.  stability  n.va  repeatability. 


Reproduced  from 
best  available  copy. 
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event  related  drain  potentials  seem  to  be  the  most  suitable 
biosignals  ror  development  or  tne  intended  application. 

i he  experimental  approach  consists  or  identifying  features  in 
the  hbJ  (evoked  responses)  which  constitute  feasible  codes  ror 
use  in  directly  communicating  specific  messages  relevant  to  in- 
teractive man-machine  communication.  Such  messages  would  be,  for 
example,  the  recognition  or  a photograph  (matching),  its  accep- 
tance or  rejection  based  on  some  criterion,  the  choice  between 
visual  alternatives  (a  visual  light  pen),  or  the  appraisal  of  a 
given  environmental  event  in  terms  of  its  meaningfulness  or  sig- 
nificance to  the  su'd  j ec  t/oper  a tor . 


2.  Progress  to  Date. 

Die  jCLA  U I wCYBhPNhi IC  COMTkOL  IN  MAN-MACHINE  INTtkACilON  Pro- 
ject has  been  underway  at  the  Drain  Computer  interrace  Laboratory 
(MCI)  jince  July  Iv/J  under  AhPA  sponsorship.  Accompl i snments  to 
a at  e ror  the  ertseirible  of  the  project  rail  into  three  categories, 
name  1 v , 

1.  Evoked  response  experiment  results  (2.1). 

2.  Computer  support  system  design  and  development  (2.2). 

3 . Development  of  computer  methodology  and  application 
software  for  real-time  online  identification  of  event 
related  Ltd  signals. (2. J) 

Die  accomplishments  during  the  first  year  and  a hair  have  been 

| 

described  in  the  Pinal  iechnical  Peport  I V/3-/e,  and  in  the 
Semi-Annual  iechnical  report  Iv/4-/j.  The  present  document  covers 
the  second  nalr  of  the  second  year  (IV/e-/‘j).  ihe  salient  items 
are  summarised  in  tne  present  section. 

2.1  PVO\p|)  rfliSPONSl;  EXPbK I MuNT  PtSuLi'S 


2.1.1  Color  Experiments 

Die  data  collected  in  the  previous  period  has  been  extensively 
analyzed,  usinj  botn  the  Bd  version  of  Stepwise  Discriminant 
Analysis,  anu  the  new  dMi)  version,  P/M.  In  the  current  analyses, 
all  trie  data  samples  had  an  opportunity  to  be  selected  for  inclu- 
sion into  the  decision  rule.  Also,  a procedure  suggested  by 
iatsuoka  (lo/l)  for  computing  the  contributions  or  each  variable 
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in  the  lecision  rule  to  the  classification  of  each  group  has  been 
utilize!,  Prom  this  orocedure,  the  Ltu  COLOW  COOt  for  each  sub- 
ject can  be  displayed,  inese  results  are  tabulated  in  tne  follow- 
ing section. 

ihe  adoption  or  a rirst  half/second  half  training/testinq  divi- 
sion or  the  Jat.a  has  resulted  rro'n  a desire  to  approximate  more 
closely  tne  proceaure  that  is  expected  to  be  useu  online,  where 
data  is  collected  rur  the  generation  of  a training  set,  and  then 
the  resulting  classification  function  is  applied  to  subsequent 

I I 6 tr  Ci  • 


bittern-position  t-.xper iments 

An  additional  series  or  experiments  testing  the  errect  or  retinal 
position  variation  was  conducted  using  various  display  configura- 
tions in  a search  fnr  a more  optimal  stimulus  for  tne  visual 
light  pen  experiments  to  be  performed,  these  experiments  were 
analyzed  online,  in  batch  mode,  and  the  results  were  used  to 
select  the  display  parameters  which  gave  the  best  results,  in 
terms  or  70  correctly  classified  stimuli  and  Mutual  information 
transfer.  these  results  are  lescribed  in  detail  in  the  followin') 
secti on. 

d.I.d  online  l-.xper i.nent.. 

In  June  or  I z/o  the  rirst  online,  real  time  evoxeo  response  clas- 
sification experiments  were  successfully  completed,  the  visual 
ii  jht  pen  experiment  was  impl  imented  on  a three  computer  networx 


A 


in  t n c HCi  Lab.  some  or  the  details  or  this  accomplishment  are 


uercrioed  in  the  following  section. 

Computer  System  developments 

In  oi-  ler  to  implement  the  online  ciassii  ication  experiments, 
towards  which  the  HCI  lab  had  directed  its  efrorts  rrom  incep- 
tion, numerous  hardware  changes  were  designed  and  constructed.  In 
particular,  three  computers  were  networked  together  so  tnat  the/ 
couio  l a 1 k riueritly  to  each  otner,  each  perrorminj  its  particular 
luriction.  i'he  SJS  ypj  acts  as  real  time  experiment  controller, 
data  col  letter,  data  analyzer,  and  generates  archive  tapes  and 
printer  mu  punched  output.  The  IMLAC  l*)b-l  is  an  intelligent 
jrnnhics  disnlnv  computer,  and  nannies  the  Ci<  1 display  ani  re- 
i ror.h  enur  es,  while  me  ol)S  vdu  acts  <as  an  I nput/Uutput  burrer, 
and  Imiuc  program  storage  computer. 

j.j  Computer  Methods log'  ani  nor tware  Development 

A massive  eiroit  wa  • undertaken  to  nrin-]  the  capabilities  or 
online,  real  time  h.-.J  evoked  response  data  analysis  and  ciasr.iri- 
catuon  to  the  operational  stage  by  the  close  or  the  contract 
ye  ar . 

me  major  prooieiru>  solved  involved  the  generation  or  a virtual 
link  loader  operating  system.  This  linking  scheme  allows  a data 
collection  pro  iram  (the  Scheduler , Li  ok  ^u)  to  collect  data,  then 
replace  itseir  in  core  with  tne  data  analysis  programsC  !3Ci  hi)A)  , 
ni.j  calculate  the  linear  di  sc’-iininant  rules,  once  the  rules  are 

b 


M mill  ini 
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obtained,  the  SI  J A link  (link  4d)  replaces  itself 
-icheduier  a;ain  for  the  performance  of  the  online  data 


with  the 
classifi- 


cation 


d.  bvuucL)  rtcSPONSbb  ribSJLl'b  SUMMAFIbb 


d.l  COLOH  bXPbFl  MbN TS 

3.1.1  Methojs 

ihe  methods  used  ror  the  collection  of  the  color  evoked  response 
data  were  detailed  in  the  Semi-Annual  Technical  Report  19/e— /b, 
and  will  be  reviewed  again  below. 

pirteen  subjects  were  evaluated,  ten  were  used,  all  were  aged 
|y-P4.  bach  was  given  a Ishihara  test  of  color  discrimination. 
Individual  recording  sessions  were  conducted  and  required  two 
hours . 

Standard  silver  disc  electrodes  are  applied  with  e i ectroconduc- 
tive  paste  at  live  locations  on  the  scalp*  P'pz,  Pz,  Oz,  1)1  and 
02,  and  to  the  earlobes,  Al  and  A2,  which  were  electrically 
paralleled.  The  electrode  impedance  was  always  less  than  10,000 
ohms.  Four  bhG  data  channels  are  recorded*  Channel  I = Pz-A, 
Channel  2 = Oz-Pz,  Channel  J = ol-Pz,  and  Channel  4 .=  02-Pz.  A 
lead  is  taken  rrom  ppz-Oz  and  used  to  scan  ror  artifacts  such  as 
those  caused  by  eyeoiinks  or  excessive  subject  movement*  ir  a 
peak  to  peak  deriection  occurs  in  this  channel  which  exceeds  a 
parameter  level,  the  data  epoch  is  aborted. 

bbC  signals  are  amplified  over  a bandwidth  of  1.0  to  10  Hertz 
anu  digitized  at  4 r.i  11 i second  intervals.  A data  epoch  consists 
of  samples  taken  botn  before  (40d  to  96 0 msec)  and  after  (d?0 
msec)  the  stimulus. 

bflMULl  consisted  of  unpatterned  colored  flashes  of  light,  for 
the  color  experiment,  superimposed  on  a background  light  which 
was  yellow  and  of  I ou  'll  lb  luminancatO.OI  iamberts)  .pour  colors 
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were  generated  by  interference  filters  with  peak  transmission 
wavelengths  at  e6b  nm.  (blue),  u I b nm.  (green),  a /b  nm.  (yellow), 
and  620  nm,  (red),  ihe  yellow  background  light  was  generated  by 
the  use  of  a Wratten  filter  #4  and  a 60  watt  incandescent  bulb 
operated  at  60  volts  by  a Variac. 

ihe  color  flashes  were  brief  (30  microsecond)  pulses  or  6000 
oegree  Kelvin  Xenon  strobe  light.  The  interference  filters  were 
nearly  isoenergetic  when  checked  with  a spectrophotometer,  but 
the  slijhtiy  blue  color  temperature  of  the  Xenon  strobe  was  not 
corrected.  I'he  intensity  of  the  light  stimuli  was  10  exp  1 lux  in 
a collimated  oeam  entering  the  interference  filters.  The  attenua- 
tion due  to  the  color  rilters  was  about  1.3  log  units. 

3.1.2  Analysis 

Data  analysis  is  performed  either  on  a SDS  V30  computer,  or  on 
the  campus  IBM  360/Pl.  Stepwise  discriminant  analysis  (SDA)  is 
used  to  develop  four  linear  discriminant  functions  (one  for  each 
of  the  four  color  classes)  which  then  are  evaluated  for  each 
epoch  in  order  to  calculate  the  posteriori  probability  of  belong- 
ing to  each  group. 

hor  this  report,  tne  SDA  routine  was  run  repeatedly  on  each  sub- 
ject in  order  to  choose  a more  optimal  subset  of  variables  for 
use  in  the  discriminant  functions.  In  order  to  accomplish  this, 
the  samples  were  entered  into  runs  in  time  slices?  variables  II 
through  20  were  taken  for  each  of  tour  t-H3  channels  for  the  first 
run,  than  samples  21  to  30,  31  to  40,  41  to  uO,  ol  to  60,  61  to 
/(),  an  i /I  to  dJ  . bach  eu  variable  run  would  go  at  most  10 
steps,  so  th°  result,  or  the  seven  SDA  runs  is  to  produce  a list 
or  at  most  /J  variables,  arid  their  b levels.  From  this  list  , 
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the  variables  with  the  hijhest  40  i-  levels  were  chosen  to  go  into 
a final  SL)A  run.  The  first  I Oo  epochs  are  taken  for  the  training 
set,  which  is  used  to  calculate  the  DR's.  The  second  I JO  epochs 
then  are  entered  as  a testing  set  of  data. 

The  results  or  these  SDA  runs  on  the  ten  color  evoked  response 
subjects  are  shown  in  iable  I. 
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RESULTS 
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s were 

obtained 
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/ 

second  half 

trai ni n 3/testi ng  set  runs  of  BCISDA  using  recursive  analyses  to  find 
tailored  sample  windows,  fcvery  sample  in  the  data  set  ( except  for  the 
iirst  10  samples  following  the  stimulus)  had  an  opportunity  to  be 
selected  by  this  procedure. 
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3.1.3  CuNTW  IliUf  I()Nb 


In  order  to  ascertain  the  contribution  of  each  variable  to  a 
given  group  discriminant  function  (U.h.)  the  following  procedure 
is  adopted,  as  sug;esteo  by  Tatsuoka  (19/1);  The  coefficients  of 
the  variables  in  the  Discriminant  hunctions  are  a first  approxi- 
mation to  the  degree  of  contribution  each  variable  provides  (on 
the  average)  to  classification  of  the  given  jroup,  but  these 
values  need  correction  by  a factor  (Vi*)  which  can  be  obtained 
in  .the  following  manner; 

Vi*  squared  = Vi/o.f.,  where  tne  Vi  are  the  diagonals  of  the 
residuals  (variances)  in  the  variance-covariance  matrix,  d.r.  is 
the  number  01  degrees  of  freedom  associated  with  the  Vi  (d.r  . = # 
of  epochs-1).  i-ach  coefficient  in  the  D.i*.  is  tnen  multiplied  by 
Vi*.  ihen,  for  a given  experiment,  these  products  are  normalized 
to  a maximum  oi  100  for  easy  comparison.  These  Contr iou t i ons  are 
tabulated  in  Tables  ^ to  /,  for  the  six  subjects  who  gave  the 
best  perfor nance  in  terms  of  percent  of  epochs  correctly  classi- 
fied 
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s.?  pattlhn^ositiom  LXFbiMMtMis 

In  orier  to  tes.  toe  probable  effect  of  adding  a cathode  ray 
Lube  (C.O)  display  to  die  stimulus  array,  in  place  of  the  back- 
ground lamp,  three  subjects  were  tested  in  the  pattern-position 
experiment,  while  varying  the  intensity  of  the  background  iamb.  A 
variac  was  used  to  adjust  the  voltage  to  the  lamp.  60  volts  was 
the  standard  high  setting  (IOj  NITS  luminance),  and  *0  volts  pro- 
viueu  a low  intensity  (I  Mil'  luminance)  to  simulate  trio  effect  of 
a Chi  display,  in  the  sane  series  of  experiments,  two  sizis  of 
checkerboard  stimuli  were  tested;  the  original  2.2  degree  visual 
ingle  display,  and  a larger  4.4  uegroe  display.  The  ciassilica- 
t i on  performance  achieved  is  given  in  iaole  o. 

fable  M 


CLASS  I MCA  1 10M  PfcriFotfhANCh  VS  DISPLAr  SlZc,  I LLu4lHAi'I ON 
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koi  erring  to  labie  d,  it  can  be  seen  that  with  subject  SAo2, 
variations  in  background  i llu  lination  or  checkerboard  size  ha  a 
little  eriect.  ihe  iorge  checkerboard  proved  to  be  better  ror 
subject  bAi)2,  While  bacKgroun  I luminance  had  little  effect.  With 
subject  bo. id  the  normal  (high)  background  gave  slightly  better 


Reproduced  from 
best  available  copy. 


I J 


results  than  a low  oacuground.  Lhe  ^.4  de  ;ree  stimulus  evoked 
larger  scalp  potentials  tnan  the  2.2  degree  stimulus;  tie  nega- 
tive polarity  I2U  to  I ju  millisecond  peak  seen  in  subject  SA 02, 
channel  I (Oz-A)  after  the  "UP"  stimulus  was  2.0  uV  and  J uV 
(Hi  jh  and  Low  background,  respectively)  with  the  2.2  degree  rield 
aiui  euv  and  4. bin/  with  the  4.4  degree  field,  ine  errect  of  de- 
creasing the  background  light  was  to  increase  the  retinal  nin 
and  thus  increase  slightly  (Id  to  la*)  the  amplitude  or  the 
evoked  response. 

It  appears  that  the  replacement  of  the  background  light  with  a 
CK 1 display  would  not  degrade  the  visual  evoked  responses  si  ;ni- 
i icantly . 


lhe  larger  4.4  degree  checkerboard  did  perform  significantly 
better  than  did  tue  original  2.2  degree  stimulus,  so  the  larger 
one  was  used  for  ail  subsequent  experimentation. 


MA/ih  hXPbKl.Mb  U' 

In  order  to  demonstrate  the  performance  of  the  online  evoked 
response  classifying  system,  it  was  decide!  to  incorporate  a 
robot  "mouse"  in  a computer  generated  maze  as  an  integral  part  of 
the  system  display. 

A diagram  of  the  maze  is  illustrated  in  Figure  I (Appendix).  The 
mouse  starts  at  node  I,  and  the  subjects  tas.<  is  to  command  the 
mouse  to  move  one  jump  at  a time  through  the  maze  by  the  shortest 
path  to  the  cheese,  at  node  II.  lhe  input  alphabet  of  commands 
necessary  to  accomplish  this  task  consists  or  the  following  four* 
UF,  Uudd,  Lt-.Fi,  hlJHI.  Lhe  commands  arr>  selected  by  the  subject 
by  directinj  the  gaze  at  one  or  the  rour  LHD  fixation  points 
arrayed  at  the  vertices  or  the  stimulus  display.  Lhe  mouse  is 

I 4 
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displayed  in  the  maze  on  a CHI'  which  constitutes  one  field  or  the 
two  rield  stimulus  display.  When  the  checkerboard  display  is 
Uriel iy  illuminated  by  a strobe,  under  computer  control,  it  ap- 
pears brieliy  to  the  subject  superimposed  upon  the  maze  display. 
uNLlNL:  uvUNdU  HbSHONSt  CLASSIFICATION! 

ine  NASA-type  LLC  helmet  was  used  ror  the  following  two  experi- 
ments. SAL)4  war.  run  as  an  offline  simulation,  with  a classifica- 
tion perfor nance  of  d2%  correct.  SAuu  constituted  the  first  suc- 
cessful online  evoked  response  classification;  the  subject  was 
able  to  command  the  robot  mouse  to  move  through  the  maze  with 
relative  ease,  usinj  the  visual  light  pen  scheme.  Overall  perfor- 
mance or  this  run  was  /o-i  correct. 

A major  milestone  oas  been  reached,  online  evokes  response  clas- 
sification has  been  achieved.  . 

lhe  detailed  plots  of  average  evoked  resoonses,  online  outputs 
from  Sl)A,  and  theoretical  considerations  for  bayesian  classifica- 
tion and  mutual  information  transfer  are  contained  in  the  Appen- 
dix. 
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4.  APPENDIX 


Inf:  appendix  contains  Figure  I,  the  Maze  diagram,  and  the  online 
results  iron  experiments  SAD4  and  SADo. 

iho  appendix  also  contains  plots  or  average  evoxed  potentials  to 
color  stimuli  i or  six  subjects,  the  averages  are  or  nO  epochs  per 
color,  iour  colors,  ror  200  epochs  total.  l'he  numbered  arrows  on 
the  plots  narx  tne  time  samples  whicn  were  selected  by  the  SDA 
program  as  the  best  discriminators.  i'he  six  samples  with  the 
highest  r levels  oi  the  ten  samples  selected  are  marked,  and 
their  number  refers  to  their  l-  level  rank  (I  is  the  highest,  o is 
th«  lowest).  the  SDA  training  set  was  the  rirst  90  epochs, 
whereas  ail  200  epochs  are  plotted.  The  last  1 OJ  epochs  were  the 
testing  sets. 

lie  next  plotted  averages  are  ror  the  pattern-posi tion  experi- 
ment. Similarly,  the  best  six  or  ten  samples  are  marked  with 
arrows  md  numbered  according  to  the  r level  ranks. 
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STEPWISE  DISCRIMINANT  ANALYSIS 
RECU*SI0N  * 1 

F LEVEL  T8  ENTER  * 2.20C 
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sad4-jnis-75-o  pattern  experiment  5 channels  hide  general  window 

DISCRIMINANT  FUNCTIONS  AFTER  10  STEPS#  WITH  D.Q.F.  * 3,0#  87. 1 

EPOCHS  ACCEPTED  UNCOND I T I ONALLY . 
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MUTUAL 

classified 

AS 

rr-  o.M- 

CORRECT 

INFORM, 

. UP 

Dews 

left 

PIGHT 

DEFAULT 

up 

92.0 

i .5004 

23.0 

.0 

.0 

2.0 

.0 

DOWN 

loo.o 

2 .0000 

.0 

25.0 

• 0 

• 0 

.0 

left 

96.0 

1 .8098 

1.0 

• 0 

2^.0 

.0 

.0 

right 

88*0 

1 .5091 

3.0 

• 0 

.0 

22.0 

.0 

total 

94.0 

1.7048 

21 


S*D  4 

TESTING  CONFUSION  MATRIX 

ource  percent  mutual 

....  CORRECT...  INFORM.  UP 

UP  75»0  1.0486  15.0 

DOWN  95.5  1.5048  .0 

LEFT  100.0  1.4044  .0 

IGMT  _ 84.2  .9898  __  _.0 

OTAu  88*9  1.2369 

IEPT  = 2 

CLASSIFIED 

DOWN 

• 0 

21*0 

.0 

.0  . 

NEPI  > 
AS 

left 

1.0 

.0 

20.0 

3.0 

» 100 

RIGHT 

4.0 

1.0 

• 0 

16.0 

TEPS  * 2 

PT-  o -V 

DEFAULT 

5*0 

3.0 

5.0 
6*0 

TESTING  C9NFUSI0N  MATRIX 

IEPT  * 2 

NEPI 

* IOC 

IEPS  - 2 

OURCE 

PERCENT 

MUTUAL 

CLASSIFIED 

AS 

pr-*  o fc 

CORRECT 

INFORM. 

UP 

DOWN 

left 

RIGHT 

default 

UP 

73.9 

1.0804 

17.0 

• 0 

1.0 

5.0 

2.0 

DOWN 

87.5  . .. 

1*3993  - 

.0 

21jl0 

2.0 

1.0 

1.0 

left 

91.3 

1.2910 

2.0 

• 0 

21.0 

.0 

2.0 

ight 

87.0 

1.1722 

.0 

• 0 

3.0 

20.0 

2.0 

OTAL 

84.9 

1.2357 

TESTING  CONFUSION  matrix 

IEPT  » 2 

NEPI 

» 100 

IEPS  ■ 2 

ource 

percent 

mutual 

CLASSIFIED 

AS 

Pf-  o-M 

CORRECT  „ 

inform. 

. . .UP 

DOWN 

left  .. 

RIGHT 

DEFAULT 

UP 

72.0 

.9924 

18.0 

• 0 

2.0 

5.0 

• 0 

DOWN 

84.0 

1.4112 

.0 

21.0 

3.0 

1.0 

.0 

left 

- 88.0 

1.2613 

3.0 

.0 

22.0 

.0 

.0 

ight.__ 

84.0 

.1*1184 

l.*Q 

-•0. 

- 3 . Q _ 

. . _ 2 1_.  0 

• o. 

otal 

82.0 

1.1958 

testing  confusion  matrix 

IEPT  « ’ 2 

NEPI 

* 100 

IEPS  « 2 

iOURCE 

percent 

MUTUAL 

CLASSIFIED 

AS 

pr- 

CORRECT 

INF0RM. 

. . UP 

DOWN 

left 

RIGHT 

DEFAULT 

UP 

72.0 

.9924 

18.0 

.0 

2.0 

5.0 

.0 

down 

84.0 

1.4112 

.0 

21.0 

3.0 

1.0 

.0 

LEFT 

88.0 

1.2613 

3.0 

• 0 

22.0 

.0 

.0 

: I GMT 

84.0 

1.1134 

1.0 

• 0 

3.0 

21.0 

.0 

OTAL 

32*0 

1.1958 

COMPLETED  10  STEPS  OF  ANALYSIS 


STtPwlSE  DISCRIMINANT  ANALYSIS  SAD5- JN1 9-75-0  PATTERN  £) 

Recursion  = 1 data  set  identifiers:  e: 


F 

LEVEL.  T8 

ENTER  - = 

2.200.. .. 

N8.  eF  DATA  = 

100 

_ F 

LEVEL.  T 8 

REMBVE  = 

2.20Q 

WGT • D » 6 *F » = 

100.00 

F 

LEVEL  8F 

VARIABLES/ 

d «e  »f  • a 

3*0/  96.0 

VARIABLE 

F 

Index 

name  .... 

LEVEI 

i 

1/020 

13. *85518 

2_  . 

1/025 

1.7.009837 

3 

1/030 

33.075112 

A 

1 #-035. 

2.659*83 

5 

1/0*0 

1.315708 

6 _ 

1/0*5 

1.263*15 

7 

1/050 

8.196180 

8 

1/055 

20.983862 

O 

2/020 

1 .*1855* 

10  __ 

2/025 

5.30730A 

11 

2,030 

*.230269 

12 

..  2/035 

.1.6968*2 

13 

2/0A0 

1.77969* 

. 1 A 

2/QA5 

A. 126825 

15 

2/050 

. 30671 A 

16 

2/  055  . 

1.102535 

17 

3/020 

6.031110 

18 

3/025 

..  22  • A 1 8901 

19 

3/030 

16.309053 

2C 

3/035 

18.875936 

V 21 

3/0*0 

6.897306 

22 

.3/0*5  . 

1.221283 

23 

3/050 

3.099672 

2A 

3,055 

5.862851 

25 

A/020 

8.853769 

26 

A/ 025 

A. 258303 

27 

A/  030 

22.376233 

28 

A/Q35 

1A. 265531 

29 

A/QAO 

19.598626 

30 

A, 0*5 

8.3*7*33 

31 

A/050 

1.329*57 

32 

A/055 

5.822729 

33 

5.  CPG 

21.820222 

3* 

5,025 

P9.977AJ2 

35 

5/030 

39.63633* 

36 

5/035 

1.6*0686 

37 

5,0*0 

*.*81712 

38 

5,0^5 

3 • 3Q  a 2*6 

39 

5/050 

8 • 4 3?p5 

<*C 

5/055 

1 8 .2?6ae>6 

23 


saD5-jmi9-75-o  pattern  experiment  5 channels  ride  general  wi 

DISCRIMINANT  FUNCTIONS  AFTER  tO  STEPS,  WITH  D.e.F.  * 


EP0CHS  ACCEPTED  UNC0ND I T I 0NALLY . 


variable 

F 

GROUP  NAMES 

DEX  NAM£ 

LEVEL 

UP 

D0WN 

left 

1 

2/  030 

.41818E 

01 

•11106E  00 

•35220E-01 

.81780E-01 

5 

2#  050 

.57813E 

01 

-.97677E-C2 

• 7387  IE-01 

.31674E-01 

0 

3,035 

r .96830E 

01 

10250E-01 

•61206E-03 

-.24258E-01 

7 

4/030. 

__.149.32L  02 

j^685,5LE_-Q2_. 

-•14.715E-01  . 

• 33248E-Q2 

9 

4,04Q 

'-.10265E 

02 

-.24236E-01 

•11391E-01 

-.12S60E-02 

0 

4,045 

. . ' .58562E 

Cl_ 

* li874.E-01_ 

_ • 30012E-03 

.23718E-01 

3 

5,020 

.71038E 

01 

-•70435E-02 

•73535E-02 

-.80218E-02 

4 

5,025 

^.10106E 

02 

•33536E-02 

-.86153E-02 

•31943E-Q2 

5 

5,030 

' .17748E 

02 

•26896E-01 

-•65272E-02 

•12961E-01 

9 

5/C5Q 

J.  a 161.41  E 

02 

- •.1090_5£r_01 

_.j25i55E-0l.. 

.743C4E-02 

CONSTANT 

-•  11767E  02 

“•  10987E  02 

- • 91997E  01 

PRI0RI  PR09ABILITY  •25000E  00  .25000E  00  .25000E  00 


P0S  TERI0RT  PROBAB  UJJY  ...FRO? GROUP  » 


EPOCH 

SUmHARY 

GR0jUP_.  NAMES 

.0. 

GROUP 

CH0ICE 

up 

D0WN 

LEFT 

RIGHT 

1 

RIGHT 

_ .00000 

. 11828. ... 

.00045 

.88126 

2 

UP 

•91995 

•oooco 

.07911 

.00094 

3 

DflWN.. 

1 FFT 

..  .<0000.0. 

j .468.70 

52330.. 

.00800 

5 

left 

• 01220 

.oocoo 

•98539 

.00241 

6 

up 

•99966 

.coooo 

_•  00003 

.00031 

.1 

D0WN 

•OOOCO 

1.00000 

.00000 

.00000 

.2 

left 

•00113 

..00174 

•61649 

.38064 

.5 

right 

•00096 

.00483 

•01020 

• 9S4C 1 

.6 

left 

?_CC015 

.00647 

•58830 

.40508 

.7 

DOWN 

\ 

•COOOO 

•99996 

•COOOO 

• 000C3 

.9 

UP 

•95729 

•oooco 

.03533 

.00737 

?o 

right 

• C0004 

• 0 0 C C 7 

.00099 

.99890 

J4 

DOWN 

.00000 

.99996 

.00003 

.OOOCI 

J6 

left 

• C0006 

.00078 

.99882 

.00035 

?3 

00  WN 

•QOOOO 

.99999 

•00001 

.OOOCI 

?9 

right 

•00106 

. OOOOO 

.00006 

.99387 

30 

up 

• 999C5 

.oooco 

.00092 

•OOOC3 

32 

LEFT 

.03263 

.oooci 

.95057 

.01679 

34 

left 

RIGHT 

.00075 

.14241 

.39970 

.45714 

37 

left 

•00043 

.OOOCO 

.96328 

.03625 

39 

right 

.00082 

• 00 1 A4 

•04065 

• 9566 9 

left 

» C030 1 

.COOCO 

•99699 

• 009C9 

*3 

DOWN 

•CCOOO 

.99357 

.00009 

.00142 

♦ 5 

u ° 

•99961 

.cocco 

•00C11 

.00028 

i)0* 

.00000 

.99996 

.00000 

.0030* 

.9 

Lr-rr 

.00427 

.COOCC 

•99544 

.00029 

A 

i y 

• 9°75  3 

.OOOCO 

.00005 

.0024? 

!caw 

3.C#  87.0 


right 

•68432E-01 

•38847E-01 

-•16553E-02 

-•23932E-01 

-.10303E-01 

•11310E-01 

-•23842E-02 

•36852E-02 

•76221E-02 

_.1Q2*6E-01 

-•91542E  01 
•25000E  00 


24 


SAD  £T"“CMT 


TRAINING-  CONFUSION- 

MATRIX. 

. IEPA  » 1 

. KEPI  = 

100  _ 

IEPS  « 2 

SOURCE 

PERCENT 

MUTUAL 

CLASSIFIED 

AS 

P.T.=  O.  8 

C9RRECT 

INFORM. 

UP 

down 

LEFT 

RIGHT 

default 

UP 

1QQ..0 

1 . S032 

23.0 

.0 

.0 

.0 

?.o 

DOwN 

95.7' 

1.6249 

• 0 

22.0 

.0 

1.0 

2.0 

LEFT 

ioo*o 

1.7101 

.0 

.0 

21.0 

.0 

4*0 

RIGmj 

95.5 

1.5403 

.0 

.0 

1.0 

21.0 

3.0 

TeTAL 

97.8 

1.6696 

TRAINING.  CONFUSION... 

MATRIX 

.lEpA.  1 

\E°I  = 

100 

IEFs  = 2 

SOURCE 

percent 

*JTUAL 

classified 

AS 

PT  * o. <o 

CORRECT 

I N|F0RM  » 

UP 

down 

left 

right 

DEFAULT 

UP 

loo  .o 

1.8312 

24.0 

.0 

.0 

.0 

1.0 

D^'.nN 

95. R 

1.7093 

.0 

23.0 

.0 

1.0 

l.o 

LE"T 

100*0 

1 .7965 

.0 

.0 

22.  C 

.0 

3.0 

right 

91*3 

1 .4323 

i.o 

.0 

1.0 

21.0 

2*0 

total 

96.8 

1.6924 

TR 

MNING  CONFUSION 

matrix 

IEPA  = 1 

NFPI  s 

ICO 

IEP3  = 2 

SOURCE 

percent 

MjTUal 

classified 

AS 

P'Tr  OM 

CORRECT 

INFORM. 

UP 

oew\ 

LEFT 

right 

default 

UP 

96.0 

1.7512 

24. C 

.0 

1.0 

.0 

.0 

C^N 

92.0 

1 . 62*3 

.0 

23.0 

l.C 

1.2 

.0 

LEFT 

96.0 

1.6031 

.0 

.0 

24.3 

1.0 

.0 

R 1 0-*  T 

86. 0 

1.3992 

1.0 

.0 

2.0 

22.0 

.0 

t^tal 

93.0 

1 • 594  4 

testing 

CONFUSION 

MATRIX 

iept  . 

2 NEPI 

» 100 

IEPS  * 

2 “ 


SeURCE 

percent 

MUTUAL 

CLASSIFIED 

AS 

CORRECT 

..  .inform  t 

- UF. 

DOWN 

-LEFT 

_ RIGHT 

...DEFAULT 

UP 

90.5 

1.3627 

19.0 

.0 

2.0 

.0 

4*0 

DOWN 

ico.c 

1.5611 

.0 

22.0 

• 0 

.0 

3*0 

LEFT 

ico.o 

1.4665 

.0 

.0 

18.0 

.0 

7.0 

right 

T9TAL 

89.5 

95.0 

1*2963 

1.4217 

.0 

2.0 

.0 

17.0 

6*0 

testinc  C9NFU 

S I PN  1 

MATRIX 

IEPT  * 2 

NEPI 

M 

o 

o 

IEPS  ■ 2 

source 

PERCENT 

^JTUAL 

CLASSIFIED 

AS 

pr*  o.6 

• CORRECT 

I \r5RM 

• UP 

DOWN 

left 

RIGHT 

DEFAULT 

up 

83.3 

1.2562 

20.0 

.0 

3.0 

1.0 

1.0 

DOWN 

ico.o 

1.7963 

•c 

24. C 

• 0 

.0 

1.0  __ 

left 

91.3 

1.3731 

1.0 

.0 

21.0 

1.0 

2.0 

right 

87.5 

1.3225 

1.0 

2.0 

.0 

21.0 

1.0 

total 

90.5 

1.4370 

TE 

STING  C3NFUSI0N 

MATRIX 

IEPT  « 2 

NEDI 

= 100 

IEPS  * 2 

SOURCE 

PERCENT 

mutual 

CLASSIFIED 

AS 

PT»  O,* 

CORRECT 

I \F0RM 

. UP 

D5WK 

LEFT 

RIGHT 

DEFAULT 

UP 

8 4 .0 

1 .23S? 

21.0 

.0 

3.0 

1.0 

.0 

down 

96.0 

1.7034 

.0 

24. C 

l.C 

.0 

.0 

left 

84.0 

1.2104 

2.0 

.0 

21.  C 

2.0 

.0 

R I Gwt 

24.0 

1.2506 

2.0 

2.0 

.0 

21.0 

.0 

total 

87.0 

1.3507 

first  on- 


ihe  following  table  is  a blow  by  blow  account  of  the 
line  maze  control  run.  In  this  first  run,  24  moves  were  required 
to  run  the  mouse  through  the  maze  to  the  cheese.  The  columns  on 
the  right  give  the  posteriori  probability  that  each  command  be- 
longs to  the  group  UP.  DOWN,  LtKi,  HIGH!.  .Vhen  the  probability 
was  less  than  the  posteriori  threshold  or  G.6,  the  epoch  was 


mouse  did  not  move  on  tnose 

EPOCH  1 rA  is 
EPOCH  2 [a  3]  is 

EP&CH  a U 41  TS 

EPOCH  4 CA  5]  is 

EPOCH  5 [A  6]  IS 

EPOCH  6 :a  7]  IS 

EP9CU  7 CA  8]  IS 

EPOCH  8 [A  9]  IS 

EPOCH  9 LAlO]__JS 
EPOCH  10  C A 1 1 ] IS 
EPOCH  11  CA12] 

EPOCH  12  CA1 3] 

EPOCH  13  CA 1 4] 

EPOCH  14  CA15] 

EPOCH  15  CA“i6] 

EPOCH  16  CA  17J 
EPOCH  17  C A 1 8 ] 

EPOCH  18  [A  1 9] 

EPOCH  19  [APO] 

EPOCH  20  CA21] 

EPOCH  21  CA22] 

EPOCH  22  [A23] 

EPOCH  23  [A24] 

EPOCH  24  [A25] 


epochs . 


OP 


is 

is 

IS 

IS 

IS 

IS 

IS 

IS 

IS 

IS 

IS 

IS 

IS 

IS 


CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSED 

CLASSEC 

classed 

CLASSED 


AS  1 
AS  4" 
-AS 


AS  3 LEFT  .00000 
AS  1 OP  .99952 
AS_2._0eww  ,00001 
AS  1 UP  .98554 
AS  4 .00000 

AS  3 L C.FT  .02232 
.99501 
.00000 
.98534 
•00003 
.00092 
.00007 
.00001 
.00091 
.00017 
.00000 
.00199 
.00001 
.99700 
.00204 
> .87448 

,00056 

u .00010 

AS  2 ,00000 


AS 
AS 
AS 
AS 
AS 
AS 
AS 
AS 
AS 
AS  1 
AS  4 
AS  1 
AS  3 
AS  3 


3 

3 

3 
0 

4 

3 

p 

4 
0 


u 

R 
U 
L 
L 
L 

DCF 

R 

L 

D 

R 

Dir. 

u 

R 


meant 

that 

the 

PonlN 

LEFT 

.09229 

.90685 

.00986 

.00000 

.00004 

.00044 

•72063 

.00000“ 

_.03Q76 

.01439 

. ..24860 
.00907 

.00039 

.00000 

>99=>60 

.00300 

.64453 

.33315 

.00000 

#.00081 

.00418 

.09035 

.00374 

.90591 

.00000 

-•01055 

.00411 

.01765 

.96482 

.01751 

•14388 

.85286 

.00234 

.00000 

.94769 

.05224 

.41593 

.44421 

.13980 

.03325 

.00474 

•96110 

.00001 

.99930 

•0J952 

.00000 

•oooco 

.03900 

•00000 

.00011 

.99789 

.10511 

.42648 

.4 t 841 

•00300 

.00015 

.00"»85 

•13a95 

•15521 

.70580 

•00000 

•00030 

•12522 

.00000 

.99944 

.00^00 

• 19792 

.73774 

.06425 

•0C300 

•ooooc 

.00900 

26 


SED  , - TIME  IN  MILLISECONDS 

YELLOW  « 

UREEN  --  — 

BLUE  « — 

27 

==* 


fjREF.N  = 
DIUE  » 


28 


CE 


RED  = 
YELLOW  = 
GREEN  = 
SLUE  « 


- TIME  IN  MILLISECONDS 


29 


3 


,6n.  --TIME  IN  MILLISECONDS 

fELLOW  = 

GREEN  = 

5LUE  = — 


31 


5 2 

0 50  100  350  200  250  300 

,ed.  — TIME  IN  MILLISECONDS 

YELLOW  = -• 

GREEN  = 

3LLE  « — 


33 


<lfN 


1 

5 ADI  COLOR  EVPOT  AVGS,  50  EPOCHS 
CH  3 01-PZ  EXPR=0C4 1 » SCALE  2.5 


0 50  100  150  200  250 

RED.  -TIME  IN  MILLISECONDS 

YELLOW  " -- 

OREEN  * 

SLUE  - — 


300 


37 


flTWl  COLOR  EVPOT  flVGS,  50  EPOCHS 
CH  1 PZ-fl,  EXPR=0CH1 » SCALE  2.5 


SO  100  150  200  250  300 


- — TIME  IN  MI  LL I SECONDS 

YELl.OM  - — • 

GREEN  = — 

SLUE  - — 


39 


o 


1 1 f 

1 3 4 


RED  * 
YELLOW 
OREEN  = 
SLUE  = 


TIME  IN  MILLISECONDS 


40 


41 


S0S1  COLOR  EVPOT  RVGS,  50  EPOCHS 
CH  3 01-PZ  EXPR=0C41,  SCflLE  2.5 


NLM1 
CH  2 


r 


S0S2-MY28-75  ONLINE  CONTROL  CHI  OZ  A 
50  EPOCH  AVERAGE  X 2.5,  EXPR=CBH1 


S0S2-MY28-75  ONLINE  CONTROL  CH2  PZ-OZ 
50  EPOCH  AVERAGE  X 2.5,  EXPR=CB'H1 


up  - - TIME  IN  MILLISECONDS 

DOWN  =»  — 

LEFT  - — 

8 1 GMT  « — 


53 


S0S2-MY28-75  ONLINE  CONTROL  CH4  02-0Z 
50  EPOCH  AVERAGE  X 2.5.  EXPR=CB41 


SAG2-MY30-75  ONLINE  CONTROL  CH2  P2-07 
50  EPOCH  AVERAGE  X 2*5,  EXPR=C£43 


SAG2-W30-75  ONLINE  CONTROL  CH3  02-'02 
50  EPOCH  AVERAGE  X 2*5,  EXPR=CB41 


5RG2-MY30-75  ONLINE  CONTROL  CHS  J-0 
50  EPOCH  AVERAGE  X 2.5,  EXPR=CB41 


rna 


TIME  IN  MILL  1 5 


SAD2- JN05-75  ONLINE  CONTROL  CHI  0 
50  EPOCH  AVERAGE  X 2.5,  EXPR=CB43 


*JP  = 
nr.'WN  » 

LEFT  • 
f<  i A AT 


TIME  IN  MILL  I 


rr  o 


D2- JN05-75  ONLINE  CONTROL  CH3  01-0Z 
EPOCH  AVERAGE  X 2.5,  EXPR=CBH3 


Ur  = 
onviN  = 
LER7  « 
CI'MT  = 


— TIME  IN  MILLISECONDS 


RD2- JN05-75  ONLINE  CONTROL  CH7 
0 EPOCH  AVERAGE  X 2.5,  EXPR=CBM3 


Misra 


r = 


TIME  IN  MILLISECOND 


I 


5 


0 50  100 

Uf.  — TIME 

DOWN  = — 

L£r7  = — 

RIGHT  » — 


150  200  250  300 

IN  MILLISECONDS 


SRD5- JN1 9-75  ONLINE  CONTROL  CHH  02 
50  EPOCH  AVERAGE  X 2.5,  EXPR=MAZE 


w.  - TINE  IN  HI LL I SECONDS 

DOWN  = 

LEFT  « — 

RIGHT  » — 


71 


SPD5- JN 19-75  ONLINE  CONTROL  CHS  1-0 
50  EPOCH  AVERAGE  X 2.5,  EXPR=MPZE 


Mil 


m 


r/9 


UP  » 
DOWN  = 
LEP7  = 
RIGHT  » 


- TIME  IN  MILLISECONDS 


o.  DAClLIi I hS 


ihe  project  is  being  conducted  under  the  auspices  of  the  Comput- 
er Science  Department,  University  of  California,  Los  Angeles, 
ihe  principal  facility  1 or  this  project  is  the  computer  system  at 
the  Drain  Computer  Interrace  Laboratory.  Laooratory  equipment 
includes  tnree  dedicated  computers  (XUS  U3U,  XUS  -V2U  anu  1 ML  AC 
DDS-I)  with  complete  peripherals  (card  readers,  card  punch,  rapid 
access  drum,  tape  drives  and  line  printer. 

Experiment  subjects  are  monitored  from  a specially  designer 
shioidei  enclosure  that  contains  various  input  levices  and  output 
displays  designed  in  a modular  rashion  ror  ease  or  interfacing 
with  tne  digital  system.  fhe  experiment  is  conducted  from  an 
adjacent  room  containing  the  control  terminals  to  the  system  com- 
puters, the  recording  equipment  for  tho  and  other  biosi^nals,  as 
well  as  voice  and  video  communication  devices.  The  amplified  buJ 
si  jnals  are  routed  to  a digitizing  station  capable  of  handling  oj 
simultaneous  channels  of  analog  input.  Uurinj  experiments,  a 
dedicated  X'DS  VOJ  computer  with  I6K  words  or  core  memory  and  2*<l 
characters  on  Magnetic  drum  arts  as  data  input  controller  and 
real-tine  experiment  control  er.  Ail  real-time  processing  func- 
tions are  performed  by  the  ViO  which  also  creates  complete  exper- 
iment rec oris  for  ori-iine  batch  processing.  fnese  contain,  for 
eic.ii  data  "epoch,"  the  experiment  parameters  (sampling  rate, 
epoch  lengths,  etc.)  speci r led  by  the  experimenter  as  well  ao 
selected  results  or  on-line  computation,  subject  responses,  etc. 
ihe  Vjj  also  controls  an  I ML AC  HUS -I  minicomouter  and  display 
terminal  with  on  of  memory  which  is  reserve!  for  the  generation 

ol  visual  leedbao1'  iispla/  and  somj  otner  runctions.  in 
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j jJi  lion,  the  F;)J  I ns  a a t and- a 1 one  computer  can  perform  exten— 
-jii/'i  c.i i cui at i ons  ana  generate  sophisticated  graphics  including 
arii  in  Li  an. 


tor  substantial  aata  processing  programs,  the  main  co:nputin .3 
power  i i provided  0/  the  campus  I B.V.  JOu/Pl  (Campus  Computing  :,'et- 
w°rs)  whic  1 i /.>  e ]ui  ppeu  wi  cn  a large  core  memory  or  4 \ bytes. 
lnj  digitized  mlj  r oacnos  the  i’M  bod/Pl  from  tne  laboratory  by 
1 special  hi  ?h  speed  uati  line  tint  is  used  to  write  an  i read 
dir  e c 1 1 / mi  1 hkI  rrom  tire  pho/g  I core.  The  jgte  transfer  is 
contra  lie  i ■•/ i t.n  a separate  processor  (XDS  9Bu)  to  allow  bufrering 
m i transier  without  inter rerence  with  experiments.  a monitor 
program  in  the  JoO/yl  controls  both  the  data  r low  and  the  pro- 
cessing protocol  rrom  a privileged  position  with  respect  to  the 
jhU/vi  operating  system  software,  thus  insuring  immediate  execu- 
tion. Complex  programs  can  be  performed  and  the  results  feu  back 
to  the  laboratory  with  minimum  turnaround  tine.  The  "awakening" 
of  thin  software  system  and  ail  subsequent  rile  handling  are 
place!  under  the  campus  time-shared  system  (UioA)  and  controllei 
iy  on  IBM  J2 / / terminal  in  the  laboratory. 


hi  flail/,  the  IJCI  laboratory 
direct  access  to  the  ABBA  Net/ork. 
accessing  a aa  transmitting  .!  ita  to 
ATC,  CCd,  Ml  f- MULT  I CS,  5bN  and  LBL  . ) 


computer  system  has  wireJ-in 
the  network  is  beirv,  used  ror 
other  facilities  (e.g.,  uCLA- 
ino  for  communication  with 


other  research  groups. 
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